CUGLIANDOLO-KURCHAN EQUATIONS FOR DYNAMICS OF 

SPIN-GLASSES. 
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Abstract. We study the Langevin dynamics for the family of spherical p-spin disordered mean- 
field models of statistical physics. We prove that in the limit of system size approaching infinity, 
the empirical state correlation and integrated response functions for these A^- dimensional coupled 
diffusions converge almost surely and uniformly in time, to the non-random unique strong solution 
of a pair of explicit non-linear integro-differential equations, first introduced by Cugliandolo and 
Kurchan. 
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1. Introduction and main results 

Markovian dynamics with random interactions can produce very complex phase transitions, and 
fascinating long time behaviors, for strong disorder (or low temperature). The physics literature 
has shown that dynamics of mean-field spin glasses is a very good field to get an accurate sample of 
possible and generic long time phenomena (as aging, memory, rejuvenation, failure of the Fluctuation- 
Dissipation theorem, see for a good survey). 

This class of problems can be roughly described as follows. Let T (a compact metric space) be 
the state space for spins and be a probability measure on F. Typically, in the discrete or Ising 
spins context F = {—1,1} and = l/2(5i + (5_i). In the continuous or soft spin context, F = / a 
compact interval of the real line and i>{dx) = Z~^e~^^^^dx , where U{x) is the "one-body potential". 
For each configuration of the spin system, i.e. for each x = (xi, ...,X]\f) G F^ one defines a random 
Hamiltonian, (x), as a function of the configuration x and of an exterior source of randomness 
J, i.e. a random variable defined on another probability space. The Gibbs measure at inverse 
temperature /3 is then defined on the configuration space F^ by 

/x^j(dx) = eM-PH^{^)Hd^)/Z^ 

The statics problem amounts to understanding the large N behavior of these measures for various 
classes of random Hamiltonians (j21j is a recent and beautiful book on the mathematical results 
pertaining to these equilibrium problems). The dynamics question consists of understanding the 
behavior of Markovian processes on the configuration space F^, for which the Gibbs measure is 
invariant and even reversible, in the limit of large systems (large A^) and long times, either when the 
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randomness J is fixed (the quenched case) or when it is averaged (often cahed the annealed case, in 
the mathematics Hterature, but not in the physics papers). 

These dynamics are typically Glauber dynamics for the discrete spin setting, or Langevin dynamics 
for continuous spins. Defining precisely what we mean here by large system size and long time is a 
very important question, and very different results can be expected (and sometimes proved, see jH] 
and references therein), for various time-scales as functions of the size of the system. We will restrict 
ourselves to the case where the system size is first taken to infinity, i.e for the shortest possible long 
time scales, much too short typically to allow any escape from meta-stable states (as opposed to the 
situation in |^ for instance). The first step is then to derive limiting equations for various quantities, 
when tends to oo. The second step is to understand the large time behavior of these limiting 
macroscopic equations. Let us be more specific by describing one of the main initial objectives of 
the theory, which is the long time behavior of the Langevin dynamics of the Sherrington-Kirkpatrick 
model and its generalization, the p-spin model. In the SK model, either for discrete or for continuous 
spins, the Hamiltonian is given by: 

^<i,j<N' 

where the randomness is due to the couplings J{ij} which are assumed to be i.i.d Gaussian centered, 
of variance in case i ^ j and 2N~^ in case i = j. In the p-spins model the Hamiltonian contains 
interaction between subsets of spins of size p, that is, 

(1.1) H^{^)= E Jn...,x^'...x'^, 

l<ii<...<ip<N 

where the couplings Jij^...ip are assumed to be i.i.d. Gaussian centered and of variance of 0{N~^p^^^). 
The initial SK model corresponds of course to the case p = 2. 

Propagation of chaos for dynamics of the SK model, or equivalently the large limit for the 
behavior of the empirical measure jj YliLi ^x*{t) has been obtained some time ago both for continuous 
spins (see ^1150], in the physics literature and [HIIZIE] for a mathematical treatment) or discrete 
ones (see |14p. The limiting equations (the so called self-consistent single-spin dynamics) are very 
complex and have resisted so far all attempts to understand their long time behavior. This is due 
in part to the fact that the empirical measure is a much too rich object. Finding an autonomous 
system of tractable equations for a proper well chosen set of lower dimensional quantities is still a 
very open question, even in the physics literature. 

But a large range of interesting and related models have been recently analyzed more successfully 
in the physics literature, i.e the spherical p-spin models (see |H1E])- The spherical version of the 
spin glass models consists of a classical simplification, that is, replacing the product structure of the 
configuration space by the sphere S^^^{\/^) of radius ^/N in M.^ , in effect, imposing on the 
configuration x a hard constraint "^iLi xf = ^- The spherical p-spin Gibbs measure is thus the 
probability measure on the sphere S^~'^{^/N) given by 

/x^j(dx) = eM-liHf{-K))uN{d^)/Z^ , 

where the Hamiltonian is given by (|1.1|) and the measure vm is the uniform measure on the sphere 
5^-1 (-y/jV). One can also study a very similar problem by replacing the hard spherical constraint by 
a soft one, i.e by replacing the uniform measure on the sphere S^~^{\n^) by a measure on 

1 ^ 

i^Nid^) = exp ( - Nf{- E x2))dx/Z^ , 

i=l 
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where / is a smooth function growing fast enough at infinity. This study has been done successfully 
(see 13, and jllj ^ in the case where p = 2, the spherical SK model. There one could obtain a very 
complete description of the limiting dynamics using only one quantity, the empirical state correlation 
function 

1 ^ 

1=1 

Indeed, this quantity was shown to have a non-random limit C{s,t), when N tends to oo, which 
satisfies an autonomous integro-differential equation. This is a rather simple setting, when p = 2, 
since this quadratic case can use the well know tools pertaining to the study of spectra of GOE 
random matrices, after diagonalization of the random matrix (Jjj). The results, though showing an 
aging phenomenon, are very far from what is expected for the true (i.e non spherical) SK model. 
The case of p > 2 is a completely different story. The physics literature, mainly Cugliandolo and 
Kurchan (see [Sj lin| 112]). has given a very rich picture of the behavior of the Langevin dynamics 
for these spherical p-spin models, which are believed to mimic in certain cases the behavior of the 
dynamics of the true SK model. The main innovation is the fact that the description of the limiting 
dynamics relies now on two objects, the empirical correlation function and the response function 
(and not only one as in the spherical p = 2 case or the whole infinite dimensional object of the true, 
non-spherical, SK model). These two functions are believed to satisfy a set of coupled non-linear 
integro-differential equations (which of course decouple in the p = 2 case). Our work establishes 
rigorously the asymptotic validity of these Cugliandolo-Kurchan equations (see ^2] for the physical 
derivation of these). We shall devote a future work to the fascinating question of understanding 
the large time behavior of the solution to these equations (see jSj or ^Ul to see what is expected). 
Some of the needed mathematical tools for attacking this problem can be found in |16j . as well as an 
intriguing link with equations arising naturally in non-commutative probability. 

We now describe more precisely our result and then the structure of this paper. 

Fixing a positive integer (denoting the system size), we consider the mean field random Hamil- 
tonian 

m 

(1.2) ^i'W = -2E5 E 

p=l ^' l<ii,...,ip<N 

where m > 2, the state variable is x = {x^, . . . ,x^) G M^, and the disorder parameters Ji^...ip = 
'^{ii,...,ip} independent (modulo the permutation of the indices) centered Gaussian variables. The 
variance of Ji^...ip is c({zi, . . . ,ip})N~P~^^ , where 

(1.3) c({n,...,ip}) = J]/fc!, 

k 

and (/i,/2, • • •) are the multiplicities of the different elements of the set {ii, . . . ,ip} (for example, 
c = 1 when ij ^ iji for any j ^ j' , while c = pi when all ij values are the same). 
Let / be a differentiable function on with /' locally Lipschitz, such that 

(1.4) sup|/'(p)|(l + p)-'-<oo 

p>0 

for some r < oo, and for some A,6 > 0, 

(1.5) iiif{/'(p)-Ap-/2+^-i}>-oo 

(typically, f{p) = n^p — iy for some r > m/2 and k ^ 1). At temperature (3~^ > 0, the soft spherical 
version of the system corresponds to the equilibrium probability measure fx^j on M.^ whose density 
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(with respect to Lebesgue measure) is 

where II • II denotes the Euchdean norm on and the normahzation factor J = f e~^^^3 ^^)~^ ^1 
is a.s. finite (by ()1.5p ). Recall that //^j is the invariant measure of the randomly interacting particles 
described by the (Langevin) stochastic differential system: 

(1.6) dx{ = dBl - f {N-^\\^tf)x{dt + l3G\^t)dt , 

where B = (5\ . . .,B^) is an N-dimensional standard Brownian motion, independent of both the 
initial condition xq and the disorder J, while 



(1.7) G^x) := --d,. (h^{^)) = ^ Jni-i,-^^'' ■ ■ ■ 



l<ii,...,ip-i<N 



for i = l,...,N. 

In Proposition 12.11 we prove that for a.e. disorder J, initial condition xq and Brownian path B, 
there exists a unique strong solution of (|1.6|) for all t > 0, whose law we denote by P^xo J' 
We are interested in the time evolution of the empirical state correlation function 



1 ^ 

(1.8) CNis,t) := -Y, 



N 

t 1 



and that of the empirical integrated response function 

1 ^ 
1=1 

under the quenched law P^xo J' ^ system size N ^ oc. Note that since {xn{s, t),0 < t < s <T} 
is not determined by N^'^ <5x| j > strategy by which the limiting equations in jHllIj are derived, 

does not apply directly in our case. 

We assume hereafter that the initial condition xq is independent of the disorder J, and the limit 

(1.10) lim ECAr(0, 0) = C(0, 0) , 

N—*oo 

exists, and is a finite. Further, we assume that the tail probabilities P(|C7v(0, 0) — C(0, 0)| > x) decay 
exponentially fast in N (so the convergence CAr(0,0) — > C(0, 0) holds almost surely), and that for 
each k < oo, the sequence i-^' E[CAr(0, 0)'^] is uniformly bounded. 

To be more specific, we consider hereafter the product probability space En = IR^ x M'^(^'™) x 
C([0, T], M^) (here T is a fixed time and d{N, m) is the dimension of the space of the interactions J), 
equipped with the natural Euclidean norms for the finite dimensional parts, i.e (xq, J), and the sup- 
norm for the Brownian motion B. The space £m is endowed with the product probability measure 
IP = /iAT 7Ar ® Pni where denotes the distribution of xq, 7Ar is the (Gaussian) distribution of 
the coupling constants J, and is the distribution of the A^-dimensional Brownian motion. 

Hypothesis 1.1. For (xq, J,B) G 8^ we introduce the norms 

N m N 

||(xo,J,B)f = ^(x^)2 + ^ Y {N'^J^,...0'+ sup Y.(^i)'. 

i=l p=l l<ii...ip<N 0^*^"^ i=l 
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We shall assume that is such that the following concentration of measure property holds on S^; 
there exists two finite positive constants C and a, independent on N , such that, ifV is a Lipschitz 
function on Ej^j, with Lipschitz constant K , then for all p > 0, 

m(^lN(^PN[\V - E[V]\ >p]< C-^ exp (-C(-|)") . 

The above concentration inequality holds for any Lipschitz function V that does not depend on xq, 
since the concentration of measure property holds for the Gaussian measures (8) Pn^ with a = 2 
(c.f. |2])- Unfortunately, assuming that the concentration of measure property holds for the measures 
Pn on M.^ does not assure the concentration of measure for the product measure p.N ^ JN ^ Pn- 
Hence, we shall have to assume a property which implies the concentration inequality of Hypothesis 
11.11 and further tensorizes (see [2| for a more thorough discussion). For example, if /Utv satisfy the 
Poincare inequality uniformly in N, then the product measures p-n'^^n'^Pn also satisfy the Poincare 
inequality uniformly in N, since the Gaussian measure 77V -Pat does. The required uniform in 
concentration property is then satisfied, with a = 1 (c.f. 

Our main result is the proof that as — > 00 the functions Cj\f{s,t) and XN{s,t) converge to 
non-random functions C{s,t) and x('5,t), that are characterized by the following theorem. 

Theorem 1.2. Let 'tp{r) = z^'(r) + rz^"(r) and 



(1.11) K^)^=Ei 



rP. 



P=i ^ 



Suppose /iiv satisfies huvothesis M.ll Fixing any T < 00, as N ^ 00 the random functions Cn and 
Xn converge uniformly on [0, T]^, almost surely and in Lp with respect to xq, J and B to non-random 
functions x(s,t) = R{s,u)du and C{s,t) = C(t,s). Further, R{s,t) = for t > s, R{s,s) = I, 
and for s > t the absolutely continuous functions C, R and K{s) = C{s,s) are the unique solution 
in the space of bounded, continuous functions, of the integro- differential equations 

{iM^s, t) = -f'{K{s))R{s, + ^ t)R{s, uy{C{s, u))du, 



t 

q2 



{l.Sd^{s,t) = -f'{K{s))C{s,t) + 13^ / C{u,t)R{s,uy'{C{s,u))du + (]^ / u'{C{s,u))R{t,u)du, 

Jo Jo 

il.l%K{s) = -2f{K{s))K{s) + 1 + 2/32 f il,{C{s, u))R{s, u)du, 

Jo 

where the initial condition K{0) = C(0, 0) is determined by liLl(]\) . 

We note in passing that for p = 2, i.e. z^(r) = r'^ /2, we get from 1)1.12^ the autonomous equation 

dsH{s, t) = (3"^ H{u, t)H{s, u)du , H{t, t) = I , 

for H{s, t) = R{s, t) ex.p{f^ f'{K{u))du), whose unique solution is the Laplace transform of the semi- 
circle probability measure, evaluated at P{s — t). Plugging this expression in (|1.13j) and (|1.14|1 . 
upon scaling both the function / and time by a factor /3, we recover the limiting equation of |S1 
(2.16)] after some integrations by parts. Further, setting K{s) = 1 and dsK{s) = in (|1.14)) . while 
replacing f'(K(s)) in (|1.12|) - (|1.14j) by a time varying constant z{s), corresponds to the hard spherical 
constraint of ^|. Indeed, the limiting equations of |12j are thus recovered. 

Note that the constant /3 can be embedded into {ap} resulting with PG^ {■) 1— > {•) and then 
having /? = 1 in the stochastic differential system (|1.6|) . Adopting this convention, we thus take 
hereafter (3=1. It is trivial to check that the explicit dependence of H1.12() - ()1.14() on (3 is indeed as 
stated, i.e., with each appearance of i^'(-), (and multiplied by (3"^. 
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The empirical quantities K^is) := Cn{s,s) and 

N N 

(1.15) A^{s,t) := -Y^G\^,)xl Fr,is,t) := -^GXx.)5?, 

j=l i=l 

play a key role in the derivation of Theorem ll.2l Indeed, with 
(1.16) 

Dn{s, t) := -f'{E{KN{t)))CN{s, t) + AN{t, s) , En{s, t) := -/'(E(i^;v(s)))X7v(s, t) + Fn{s, t) , 
the key step of the proof of Theorem 11.21 is summarized by 

Proposition 1.3. Fixing any T < oo, in case (3=1, any limit point of the sequence (ECat, E^at, EDjV; EE^^r) 
with respect to uniform convergence on [0, T]^, satisfies the integral equations 

ft 



{l.U()s,t) = C{s,0)+x{s,t)+ [ D{s,u)du, 

Jo 

(l.l)gOs,t) = sAt+ E{u,t)du, 
Jo 



D{s,t) = ~f'{C{t,t))C{t,s) - v'{C{t,u))D{s,u)du- I C{s,u)u"{C{t,u))D{t,u)du 

Jo Jo 

(1.19) +C(s, t V sy{C{t V s, t)) - C{s, 0)i/'(C(0, t)), 

Eis,t) = -f'{C{s,s))x{s,t)- [\'{C{s,u))E{u,t)du- fxiu^ty {C{s,u))D{s,u)du 

Jo Jo 

i-tAs 

(1.20) +xis,ty{Cis,s))- i^'{C{s,u))du, 

Jo 

in the space of bounded continuous functions on [0,T]^ subject to the symmetry condition C{s,t) = 
C{t, s) and the boundary conditions E{s, 0) = for all s, and E{s, t) = E{s, s) for all t > s. 

We next detail the organization of the paper, and hence, that of the proof of Theorem 11.21 
In Section [21 we prove the existence of strong solutions xt for the Stochastic Differential System (in 
short SDS) given in H1.6() . for any N < oo (see Proposition 12. 1() . We then prove that the functions 
Aj\f, Fj\f, xn and Cn associated with these solutions have uniformly bounded (in A^) finite moments 
of all order, and form pre-compact sequences with respect to uniform convergence on compacts 
both almost surely and in the mean (see Proposition 12. Applying the "localized concentration 
of measure" of Lemma l2.5| we complete the preliminary analysis of the finite size SDS by proving 
in Proposition 12.41 that as — > oo each of the four functions An, F/v, xn and Cat "self- aver ages" , 
namely, concentrates around its mean. These results rely on the bounding in Appendix El norms of 
the disorder J that are expressed as the supremum of certain Gaussian fields. 

The proof of Proposition ll.^-iL namely, that each limit point of (ECat, Exat, EZ^a^ , Ei^Af) must satisfy 
(|1.17|) - (|1.2flj) . is the subject of Sectional Of these equations, upon multiplying the integrated form 
(|3.H) of our SDS by xl or by Bl, then averaging over i and the probability space, both (TTTTl) and 
(|1.18|) are immediate consequences of self- averaging. The crux of the proof is thus Proposition I.S.ll 
where we show that as ^ oo, both E,Afyf and Ei^V are well approximated by certain combination of 
our four functions, thereby leading to (|1.19j) and (|1.2n|l . The emergence of z/'(C(s, u)) and u"{C{s, u)) 
in the latter pair of equations, and hence in Theorem 11.21 is a consequence of the structure of the 
covariance kernel kts{x) = Ej[G*(xf)G-'(xs)], obtained by integrating over the disorder parameters 
J assuming their independence of the frozen path x^ (see Lemma l3.2|) . However, the main difficulty 
of the proof is the intricate dependence between J and {xf,0 < t < T}. Taking full advantage of 
the Gaussian law of J and the Brownian law of B, this difficulty is dealt with by combining the 
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Ito's calculus identities of Appendix ^ with Girsanov's theorem and the resulting Gaussian change 
of measure identities that are derived in Appendix [O This approach succeeds in deriving a "closed" 
system of finitely many limiting equations thanks to the fact that apart from our self-averaging 
global quantities, the kernel kts is a quadratic form of x. Note that certain Hamiltonians other than 
H1.2|) also have such a property, hence are amenable to a similar treatment (one such example is 
i/j^(x/||x||)for//i^(.) of US). 

Section mostly deals with analytic considerations. Its starting point is Lemma l4. 11 showing that 
any solution of (|1.17|) - H1.2U() is sufficiently differentiable to give rise to a solution of ()1.12|) - H1.14|) . 
This is followed by Proposition 14.21 establishing the uniqueness of the latter system of equations 
by a Gronwall type argument. Using these two ingredients, as well as the pre-compactness and 
self-averaging of our four functions, we conclude by deducing Theorem 11.21 out of Proposition 11.^1 



2. Strong solutions, self-averaging and compactness 
We start with the almost sure existence of the strong solution of H1.6() . 

Proposition 2.1. Assume that f is locally Lipschitz, satisfying ilj.,5)) . Then, for any N £ N, almost 
any J, initial condition xq and Brownian path B, there exists a unique strong solution to U.f^) . This 
solution is also unique in law for almost any 3, and xq, it is a probability measure on C(M+,] 
which we denote t- Further, with 

xo,J ' 



(2.1) l|J|||^ = ™ax sup 

i<P<™||ui||<i,i<i<p i<i,<'^i<fc<p 



we have for 6 > of lll.5\) . q := m/{25) + 1, some k < oo, all N, z > 0, J, and xq, that 
(2.2) , ( sup K^it) > K^iO) + k{1 + + z)< e"^^ . 



■teK+ 



Consequently, for any L > 0, there exists z = z{L) < oo such that 
(2.3) Pf sup KN{t) >z)< e~^^ . 



Proof: For every M > we introduce a bounded globally Lipschitz function (j)M on R which we 
choose such that </>Af(x) = x when ||x|| < V NM , and then consider the truncated drift b^\\i) = 
(5f (u), . . . , 6jif (u)) given by 6f (u) = G'(</.m(u)) - /'(iV->|2 A M)u\ 

Since /' is locally Lipschitz, and since ||J||^ is finite almost surely for all p and , it is thus 
clear that the drift 6^^(u) is globally Lipschitz. The existence and uniqueness of a square-integrable 
strong solution u^*^) for the SDS 

dT/j = bfiut)dt + dBi 

is thus standard (for example, see jl71 Theorems 5.2.5, 5.2.9]). With u^*^) defined for all M on the 
same probability space and filtration, consider the stopping times tm = inf{t : ||uj^'^''|| > V NM}. 
Note that u^*^) is the unique strong solution of H1.6|) for t G [0, tm], with tm a non-decreasing 
sequence. By the Borel-Cantelli lemma, it suffices for the existence of a unique strong solution 
u = hmM^oo u(*^) of the SDS ((LSI) in [0, T], to show that 

oo 

(2.4) J^P(rAf <r) <cx,. 
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To this end, fix M and let = uj^^|^^ and Zs = 2N^^ X^i^i /o*^^" ^t^^t- ^PPlyii^g Ito's formula for 
CNit) = A^~"^||xt|p we see that 

(2.5) Cjv(g) <Cjv(0) + 2V /" / CN{t)^dt-2 f'iCN{t))CNit)dt + + s Atm . 

^(p-l)Wo Jo 

Since x^~~ f'{x) oo, it follows from (|2.5() that there is an almost surely finite constant c(||J||;^), 
independent of M, such that 

(2.6) Cn{s)<Cn{0)+c{\\3\\^)s + Zs 

As the quadratic var iation of the martingale Zs is (4/iV) J^^'^"' CN{t)dt < AsN'^M, applying 
Doob's inequality (c.f. Theorem 3.8, p. 13]) for the exponential martingale = exp(AZs — 
2{X'^/N) f^^''"' CN{t)dt) (with respect to the filtration {Ht} of B^), yields that 

(2.7) P ( sup{Z, - 2 / CN{t)dt] >z \ < P ( sup Lf > e^^ I < e"^^ , 

\s<T Jo J \s<T J 

for any z > 0. Therefore, (|2.6|) shows that with probability greater than 1 — e~^^, 

I-sAtm 

Cn{sAtm)<Cn{0) + c{\\J\\^)T + z + 2 / CN{t)dt , 

Jo 

for all s <T, and by Gronwall's lemma then also 

(2.8) supiV-Vlf^l/ < [Cj,{0)+c{\\3\OT + z]e'^. 

t<T 

Setting z = M/3, for large enough M (depending of N, J, xq and T which are fixed here), the 
right-side of (|2.8jl is at most M/2, resulting with 

P(rM < T) < e-*^^/3, 

and hence with (|2.4() . We also have weak uniqueness of our solutions for almost all J since the 
restriction of any weak solution to the stopped cr-field Tirj^j for the filtration Tit of Bj is unique. We 
denote this unique weak solution of H1.6|) by P^^ j . 

Turning to the proof of ()2.2I) . by (jl.Sj) . for any c > there exists k < oo such that for all r,x >0, 



2[f'{x)x - r J2 -f^] -l>cx-K{l+ ry. 



GpX^ 

Taking r = ||J||^, we see that by ()2.5() . for all N and s > 0, 

rsATM 



Cn{s a tm) < Cn{0) - / [cCN{t) - k(1 + \\3Cy]dt + , 

Jo 



where {Zs)s>o is a martingale with bracket (4iV~i J^^^"' CN{t)dt, s > 0). 



By Doob's inequality (|2.7I) . with probability at least 1 — e 

fSATM 



zN 



fSATM 

sup Zu<2 CN{t)dt + z, 

^satm Jo 



u<sAtm 

for all s > 0. Setting c = 3 we then have that 

fSATM 

(2.9) Cn{sAtm) < Cn{0) + z- CN{t)dt + K{l + \\3\Ol{sATM), 

Jo 
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SO that by Gronwall's lemma, 

i-sAtm 

Cn{s a tm) < e-^^"*^(C7v(0) + z) + k(1 + ||J||^)9 / e~'dt 

Jo 

from which the conclusion ()2.2() is obtained by considering M — > oo. 

In view of the assumed exponential in decay of the tail probabilities for K]\f{0) and the bound 
HB.7|) on the corresponding probabilities for ||J||^ we thus get also the bounds of ()2.3() . □ 

Our next lemma provides bounds on G*(x) of ()1.7() which we often use en-route to the uniform 
boundedness of moments, pre-compactness, and concentration around the mean of the functions A^, 
Fn, Xn, and Cn- 

Lemma 2.2. There exists a constant c < oo such that, for all N < oo and every x, x G 

(2.10) - ' < c||J||^[l + (^||x|n^][l + (^llXin^f'lllx - XI 
1=1 

and in particular, 

r 1 ^ .1 1 

(2.11) [^E^^wf + 

i=l 

Proof: Fixing N, x, x and y € M^, note the telescoping sum 

N m p—l 1—1 p—1 

E(G^(x)-G^(w = E7^^EE'^n...v(n^*")(^'-^')( n ^^'^y'^ 

i=l p=l '' 1=1 ik h=l h=l+l 

Recall the definition ()2.1|) leading to the bounds, 

i-i p-i 



ik h=l h=l+l 



2- P-'-l II ~ 

, > ) 2 X — X y 



for l<l<p — l<m — l. Consequently, we get for some c = c(ai, . . . , am) < oo which is independent 
of N, that 

N 1 _ 1 _ 

E(G^(x) - G\S.W < c||J||^[l + (^||x|p)^][l + - X||||y|| , 

1=1 

for all X, X and y. Taking = G*(x) — G*(x) results with the bound of H2.10() . out of which we get 
the bound ()2.11|) by considering x = 0. □ 
By the estimate ()B.6p of Appendix^ we know that for any k < oo, 

(2.12) supE[(||J||^)^]<oo, 

N 

for the norm ||J||^ of (gH). By the boundedness of iV E[Kn{0)''] and (g^ the bound (|TT^ 
immediately implies that for each k < oo, also 



(2.13) supE sup KN{tr 

N 



< OO . 



Building upon 1)2.12(1 and (|2.13() we next prove uniform moment bounds and pre-compactness of 
the functions of interest to us. 
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Proposition 2.3. LetUN denote any one of the functions An, F/v, xa^ andCN. Then, E[supg_^<2- |?7Af (-s, 
is uniformly hounded in N , for any fixed T < oo and k < oo. Further, for any fixed T < oo, the 
sequence of continuous functions Ui\i{s,t) is pre- compact almost surely and in expectation with respect 
to the uniform topology on [0,T]^. 

Proof: We start with the uniform bound on the moments A^, F/v, XN and C^. To this end, let 
BN{t) ■■= jj E^=i l^if and GNit) := ^ EZi \G'{^t)\^. Fixing T, A; < oo let \\Kn\\oc ■= sup{Kjv(i) : 
< t < T}, and similarly define ||Sjv||oo) IIGatHoo and ||?7Af||oo := sup{C/Af (■?, t) : < s,t < T}. 
A key estimate is then the following, 

(2.14) supE[(|| J||^)'=] + supE[||K;v||L] + supE[||SAr||^] + supE[||G;v||L] < oo , 

N N N N 

holding for each fixed k. Indeed, the bounds on ||J||^ and ||i^Ar||oo are already obtained in H2.12() 
and ()2.13|1 . whereas by ()2.11|) we have that 

(2.15) (G^(t))l <c||J||^[l + E:^(t)V], 

yielding by (|2.12j) and (|2.13|) the uniform moment bound on ||GAr||oo- Finally, it is easy to show that 



(2.16) P(||S^||oo >4r(3 + x)) < e-^^ 

for all T,N < oo and x > (c.f. [SJ (3.44)]), thereby providing a uniform bound for each moment of 
1 1 -Sat I loo and concluding the derivation of (|2.14|) . 

Similarly, by (|2.3|) . (|2.15j) . (|2.16|) and the exponential in N bound of (|B.7|) on the tail of ||J||^, we 
have for each L > 0, that there exists M = M{L) < oo such that for all N , 

(2.17) P(||J||^ + IlKjvlloo + \\Bn\U + \\Gn\U > M) < e-^^ . 

In view of (|2.14l) and (|2.17|) . we get the uniform in N bounds on moments of ||f/Ar||oo and the 
exponential in bounds on the tail probabilities for ||C/Ar||oo upon observing that 

\CN{s,t)\ < KN{s)+KN{t), \xN{s,t)\<KN{s) + BN{t), 

\AN{s,t)\ < GN{s)+KN{t), \FN{s,t)\<GN{s)+BN{t). 

With the previous controls on ||C/Ar||oo already established, by the Arzela-Ascoli theorem, the pre- 
compactness of Un follows by showing that it is an equi-continuous sequence. To this end, observe 
that such U]\f{s, t) are all of the form Yld=i ^\^t hence, 

N , N 



\UN{s,t) - UN{s',t')\ <^Y1 \< - <m + ^ E i^^'ii^t - ^t'\ 

1=1 1=1 

N N N N 

s E \< - -v] E m + E I"? - m E 



1211/2 



i=l i=l i=l i=l 



Here the functions and are either x^, or G{xt). So, in view of ()2.14|) and ()2.17|) . it suffices 
to show that for any e > 0, some function L{6, e) going to infinity as 6 goes to zero and all N, 



N , N 



\l^2\bl-bl'\']>e)<e-'^(''^^'', sup E [1 - pj < L(5, e)-i , 

\t-t'\<5^N f^^ J |t_t,|<5 INf^^ J 

where b = x, B or G(x). Obviously, this holds for b = B, in which case the expectation equals 5 
regardless of N and the tail probability bound follows upon considering the union of such probabilities 
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for t, t' e [i6, {i + 2)5], i = 0,1, ... ,T/6 and applying ^^TT^ with T = 26. In case b = G(x), note 
that by (|2.1U|) we have that 



1 ^ 1 

- Y.{G\^t) - G\^t')? < 4c2(|| J||^)2(_||xi - X,, f )(1 + + KM{t'] 



(m-2)^ 



for all t,t' . Thus, in view of the bounds H2.14() and (|2.17|1 . everything reduces to showing that 



N 



(2.18) P( sup - Y, 



> e) < e-^'(^'^)^, sup E 
\t-t'\<5 



N 



i-Y 



<L'(5,e)-i 



1=1 



for some L' with the same properties as L. To this end, note that by (|1.6|) 



\x\-x\,\<\Bl-Bl,\ + \\f{KN)\\c 



xl\du+ / \G\^u)\du. 



So by (|1.4|) . for some universal constant pi < oo, all t,t' and A^, 



1 ^ 

i=l 



- \Bl - Bl,\' + 3\t - tf [pi(l + IIK^I 

i=l 



\2r 



||i^7v||oo + ||G^|| c 



□ 



Thus, by (pHl) . (pJ6l) and (EIZI), we readily obtain (pT8|l . 

A key ingredient in the derivation of the limiting dynamics is the "self-averaging" of the functions 
An, F]\f, Cn, Xn (and hence of Da? and En), as we next state and prove. 

Proposition 2.4. Assume that the concentration of measure of Huvothesis [7771 holds, and as before 
let Un denote any one of the functions An, Fn, Xn O'nd Gn- Then, for any T < oo and p > 0, 

(2.19) X^'^t^^P \UNis,t)-E{UNis,t))\ >p] < cx). 



N 



s,t<T 



implying by the uniform moment bounds on \\Un\\oo that 



(2.20) 



lim sup E 

N^oost<T 



\UN{s,t)-EUN{s,t)(' 



0. 



Our strategy relies on the following general "localized" version of the concentration of measure 
property, which might be of some independent interest. 

Lemma 2.5. Suppose Vn are functions on normed spaces £n in which the concentration of measure 
of Huvothesis \l.I\ holds. Assume that K = sup^E[y^]^/^ < oo and that for every M < oo there exists 

a subset Cn m of £n on which \ Vn\ < 2M and Vn is Lipschitz with Lipschitz constant An m ^ 
Further assume that, for every L > there exists an M = M{L) such that P[£^ ^] < exp(— LA^) for 
all N . Then, 



(2.21) P[|yjv - E[Vn]\ >P\< G-' exp (-C( 



')N2) + i{K + M{L))p-^e 



1 -LA/2 



+ e 



-NL 



'2D{M{L))' 

Proof: Recall that for every M < oo there exists a globally Lipschitz function 

U^\z)= sup {VN{y)-AN,M\\^-y\\} 

on £n^ of Lipschitz constant An^m-, which coincides with Vn on the set Cn,m- These properties are 
inherited by V^^ = max{U^^,-2M) for which also |V^^| < 2M. We thus get (|T7T|) by combining 
the triangle inequality 

\Vn - E[Vn]\ < \Vn - V^'\ + \V^' - E[F/]| + \E[V^'] - E[Vn]\ , 
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with the Cauchy- Schwartz inequahty 

\nVN - V^']\ < E\Vn - V^'\ < 2MP(£^,,,) + E[\VMlc^^J < {K + 2M)¥[C%^m]^'^ , 

and applying the concentration of measure inequahty of Hypothesis 11.11 for V^^ . □ 
Proof of Proposition 12. 4t We wish to apply the estimate H2.21() to Vn = UN{s,t) for any of our 
four functions, and any fixed pair of times s, t. To this end, for each M < oo and any N define the 
subset 

Cn,m = {(xo, J,B) E £n : ||J||^ + \\Bn\\oo + \\Kn\U + \\Gn\U < M } 

of £n. For M sufficiently large, the probability of the complement set C^^^ m decays exponentially 
in by ()2.17|) . whereas by Proposition 12.31 we have the uniform moment bounds for the functions 
U^is, t), as well as the stated pointwise bound in Cn,m- It thus suffices to prove the stated Lipschitz 
constant of Vn on Cn,m- We start by showing next that restricted to the set Cn,m-, the solution x 
of H1.6() is a Lipschitz function of the triple (xq, J,B). 

Lemma 2.6. Let x,x he the two strong solutions of M.b]) constructed from (xq, J,B) and (xq, J,B), 
respectively, //(xq, J,B) and (xq, J,B) are both in Cm,m, then we have the Lipschitz estimate: 



(2.22) supl kj-xj|2<^^^^fl^||(xo,J,B)-(5o,J,B) 



|2 



where the finite constant Do{M,T) is independent of N. 

Proof: We denote by G*(-) (resp. the Gaussian fields constructed from the J (resp. J). We 

write the following natural decomposition: 

N ^ N 



1 1 / 

,—1 1 V 



i=l i=l 

(2.23) - l\f'{KN{u))- nKN{u)))x\,du- I f'{KN{u)){x\-x\)du 



+ f{G\^u) - G\^u))du + f{G\3^u) - G\^u))du 
Jo Jo 



Then, since ||i^Ar||oo ^ ^ and Hi^Arlloo < M, we have that for some finite C{M, T) that is independent 
of N and for all c > 0, 

N N 

i=l i=l 
N 1 ^ _ 

^2 ^ ^E(-^--D' + ^E(^?-^*T 



i=l i=l 

N ,t , N 



" ft 1 " 

i=i -^^ 1=1 



O du 



N ^ m 

i=l p=l l<ii...ip<N 
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We can bound the term I5 on Cn,m, using ()2.1U|) of Lemma by 



N \ h / , N \ 5 



I,<C{M)\\3\\^l^ l^^p^ixi-x'ifj l^lp^ixl-xlfj du 

N »t TV 

< C{M, T) (-^ ^(xj - x\f + Yn ^^"^^ " ^«^'^'') ' 
i=i •'^ ^ i=i 

for some C{M,T) independent of N and all c > 0. Adding these estimates we get the bound 

e7v(t) <C(M,r)[ce7v(t) + 4?ll(xo,J,B)-(5o,J,B)f + - / eN{n)du\ , 
I cN c Jo i 

on ejyit) of H2.23() . so for c = c{M,T) > small enough, Gronwall's lemma yields the stated bound 

Equipped with Lemma 12.61 it is now easy to prove that 

Lemma 2.7. Let x, x be the two strong solutions of U.6}) constructed from (xq, J,B) and (xq, J,B), 
respectively. If (xq, J,B) and (xq, J,B) are both in Cn,m, then we have the Lipschitz estimate for 
each of the four functions UNis, t) of interest, 

(2.24) sup \UN{s,t)-UN{s,t)\ < ^^^^^ ||(xo,J,B)-(xo,J,B)||, 

s,t<T V N 



where the constant D{M,T) depends only on M and T and not on N. 

Proof: Since each of the four functions UN{s,t) is of the form "^{Li o-lbl, we have that 



N , N 



\Un{s, t) -UN{s,t)\<^Yl \< - ^sMl + ^ E \^sm - h\ 



1=1 1=1 



N N N N 

i E i'4 - m E m + iw E I"; - m e i<n ■ 

i=l i=l i=l i=l 

Here the functions at and are either x^, or G(xf). This bound and Lemma 12.61 are sufficient 
to prove the conclusion of the lemma for the two functions Cn{s, t) and XNis, t). To prove it for the 
other two functions Ajv(s,t) and Fiy{s,t), note that by (|2.1UI) we have the bound 

[l^^\G\..)-G\3c,)\Y'<CiM)\\J\ai + M^)[^ Y: K-^^'^\ 

i=l l<i<N 

holding on Ciy,M, so combining the obvious consequence of Cauchy- Schwartz 

i=l p=l l<ii...ip<N 

on Cn,m, with Lemma ITBl one gets 

[1 X; - < IK-o, J, B) - (Xo, J, B) II . 

i=l * 
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Moreover, the estimate (|2.11() gives the bound 

1 ^ 

[-^\G\^t)\'f'<c\\3\\!^il + M^-')<C{M). 
1=1 

The last two estimates and Lemma ['2.6l thus yield the conclusion H2.24() for both Ajv(s, t) and Fn{s, t). 

□ 

In view of Lemma 12.71 the inequality 1)2. 21() applies for Vn = UN{s,t), for any fixed s,t <T with 
constants K and D = D{M{L),T) that are independent of s, t, p and A''. Consequently, by the union 
bound, for any finite subset A of [0,T]^, and any p > 0, the sequence A'" i-^ IP'[sup(s^t)g_4 \UN{s,t) — 
EC/7v(sji)| ^ p/3] is summable. 

Recall that in the course of proving Proposition 12.31 we showed that for any e > there exists 
L{5, e) ^ oo for 6^0, such that for all N, 

P( sup \UN{s,t)-UN{s',t')\> e) <e-^''^''^^ , sup \EUN{s,t)-EUN{s' ,t')\ < L{6,e)-^ 

\s-s'\ + \t-t'\<S \s-s'\ + \t-t'\<5 

Choosing 6 > small enough so that L{26,p/3) > 3/p > 0, we thus get ()2.19l) by considering the 
finite subset A = {{i6,j6) : i,j = 0,1, ... ,T/6} of all points of [0, T]^ on a 5-mesh. □ 
We shall often apply the following direct consequence of Propositions 12.31 and 12.41 

Corollary 2.8. Suppose that : ^ M is locally Lipschitz with 1^(^)1 < M||2||^ for some M, i,k < 
oo, and Zj^ G is a random vector, where for j = 1, . . . ,£, the j-th coordinate of Z]\f is one of the 
functions A^, , xn or Cn evaluated at some {sj,tj) G [0, T]^. Then, 

lim sup \E^{Zn) - ^(IEZat)! = . 

Proof: It follows from Proposition 12.31 that R = supg. ^. j^i ||E(Z7v)||fc < oo. For each r > let Cr 
denote the finite Lipschitz constant of \I'(-) (with respect to || • II2), on the compact set := {z : 
ll^llfc < r}. Then, 

|E^(Z;v) - 1'(EZjv)| < EI^'(Z^) - ^(EZN)\lzr,eTr + n^{ZN)\lz^trr + |^(EZjv)|P(Zjv ^ F,) 

< c,.E[||Ziv - EZjvlb] + 2£Mr-^'E||Ziv||f . 

We have by 1)2. 20() and the uniform moment bounds of Proposition lT^ that supg_^.^^^. E[||ZAr— EZAr||2] — > 
as — > cxD, while c' = sup^ E||ZAr||^'^ < 00, implying that 



-k 



lim sup lE^'(Z^) - ^'(EZtv)! < 2ceMr-^ , 
which we make arbitrarily small by taking r — > 00. □ 



3. Limiting equations: proof of Proposition 11.31 
We shall denote in short 

CUs,t)=E[CN{s,t)], XN{s,t)=E[xN{s,t)] 

where expectation is over the Brownian path B, the disorder J and the initial condition xq, and 
adopt a similar notation for other functions of interest. 
Integrating the SDS p.Hj) we have that 

(3.1) xl = x'o + Bi- r f'{KN{u))xidu + r G\jcu)du . 

Jo Jo 
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Hence, upon multiplying by x] and Bf followed by averaging over i and taking the expected value, 
we get that for any s,t £ M"^, 



(3.2) CUs,t) = C%{0,t)+XN{t,s)- E[f'{KN{u))CN{u,t)]du+ A%{n,t)du 

Jo Jo 

(3.3) XNis,t) = XNiO,t) + tAs- E[f'{KN{u))xN{u,t)]du+ Ff^{u,t)du. 



In the following, we use ~ when aAr(-, •) — 6Ar(-, •) ^ as — > oo, uniformly on [0,T]^. Ap- 
plying Corollarv 12.81 (for ^[z) = zif'{z2) whose polynomial growth is guaranteed by our assumption 
(|1.4|) '). we deduce that 

nf'{KNiu))CNiu,t)] ^ f{K%{u))C%{u,t), nf{KN{u))xN{u,t)] ^ f {K%{u))x%{u,t). 

Our next proposition, approximates the terms A'^ and Ff^ which we need in order to compute the 
limits of (1221) and as iV ^ oo. 

Proposition 3.1. We have that 

psVt 

A%{t,s) ~ i^'iC%{t,t\/s))C%{s,t\/s)-iy'{C%it,0))C%is,0)- u'{C%{t,u))D%{s,u)du 

Jo 

psVt 

(3.4) - / iy"{C%{t,u))C%{s,u)D%it,u)du. 

Jo 

Further, 

rtAs rs 

F^{s,t) ~ xUs,tAsy{C%{s,s))- u'{C%{s,u))du- u'{C%{s,u))E%{u,tAu)du 

Jo Jo 

(3.5) - / x%iu,tAuy'{C%is,u))D%{s,u)du. 



Deferring the proof of Proposition 13.11 we first use its conclusion to complete the proof of Propo- 
sition E31 To this end, note that Bq = so F^{s,0) = 0, for all and s. Further, with 
Qs = cr{J, xq, Bu, u < s), we have by H1.15() that for all and t > s, 

1 ^ 

F^{s,t) = F^{s,s) + -^E[G^(x,)E(i?,^ - Bl\g,)] = F^(.,.) 

i=l 

(recall the independence of B^ — B^ and Qs)- By the same reasoning also Xn^.^^ ^) ~ 0' ^Ni^' ~ 0' 
£"^(5,*) = E'^{s,s) and x'his,t) = XNis,s) for ah iV and any t > s > (cf. ((121) and (TTmll V 
Likewise, by definition C^(t, s) = C^{s,t). 

Let ^C,x,D,E) : C([0,T]2)4 ^ C([0,r]2)4 denote the difference between the two sides of equa- 
tions H1.17() - ()1.2U() . In view of the above boundary and symmetry conditions, comparing (|3.2() - (|3.5() 
with (tTTTIl - ltT:^ we see that <^>{C'^,x%, D%, E'^) ^ as N ^ oo, uniformly on [0,T]^. It is not 
hard to check that $(•) is continuous with respect to the topology of uniform convergence, hence 
$(•) = at any limit point of (C^, Xat, -C^, -B^), which also necessarily satisfies the same boundary 
and symmetry conditions, thus completing the proof of Proposition 11.31 □ 

As already noted, the first step in proving Proposition 13. II is. 

Lemma 3.2. Let Ej denotes the expectation with respect to the Gaussian law Pj of the disorder J. 
Then, for each continuous path x G C(M+, M^) and all s, t G [0, T] and i,j E {1, . . . , N}, 

(3.6) := Ej[G*(xOG^'(x,)] = ^u"{CN{s,t)) + l,=,z.'(C7^(s, t)) . 
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Proof: Observe that G*(x) of H1.7|) are, for any given x, centered, jointly Gaussian random variables. 
Further, by our choice of c({ii, . . . , ip}) it is not hard to verify that for any . . . , ip^i = 1, . . . ,N 

p-i 

(3.7) c({i,ii,...,ip_i}) J2 hiAi,...,ip^i}={jji,...,jp-i} = ip-'^)-ih=i + ^h=ir)- 

l<ji,-,jp-i<N r=l 

Hence, by l|1.7jl and (|3.7j) . we have that for any given vectors x and y, 

m . s 2 

P=l h,-- ,ip-l,jl,--- dp-l 

m ^2 P-1 



n,---,ip-l r=l 



p=l ' 1=1 p=2 ' l=\ 



SO that with v{p) = J2^=i ~^f^^^ have. 



(3.8) E[G^(x)G^(y)] = .'(1E-V) +^-"(^E-V 



N ^ "J N \N 

1=1 1=1 



Further, if i / j, then by (|3.7p we also have that 

m, / \ 2 



P=2 ii,— ,ip-i,ji,— ,jp-i 

m 2 P— 1 

Er^^^"^"""'^ E J2^j=irx'x''---x'''-'yY'---y'''-' 

p=2 ^ ' ii,--- r=l 

p=2 ' e=i 



implying that when i ^ j, 

N 

N " \N 



(3.9) E[G^(x)G^(y)] = ^^^"(l^x^y^ 



=1 



so replacing x and y by x^ and x^ respectively, we immediately get (|3.6j) out of (|3.8j) . (|3.9jl and the 
definition of Cn{-, •)• ^ 

Proof of ProDOsition l3.H Fixing a continuous path x, let kt denote the operator on L2({1, • • • A^} x 
[0, t]) with the kernel k = A;(x) of (1221). That is, for / e L2({1, • • • iV} x [0, t\), u <t, i £ {I,-- - , N} 

(3.10) [ktf]l, = E / KivUdv, 

,=1 -^0 
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which is clearly also in L2{{1, • • • N} x [0,t]). We next extend the definition p.lUf) to the stochastic 
integrals of the form 

TV 



where Z^ is a continuous semi-martingale with respect to the filtration J^t = (^{^u ■ < u < t) and 
is composed for each j, of a squared-integrable continuous martingale and a continuous, adapted, 
squared-integrable finite variation part. In doing so, recall that by 1)3. 6|) each ku^^x) is the finite 
sum of terms such as xl^ ■ ■ ■ x^^xi^ ■ ■ ■ xi'' , where in each term a, b and ii, . . . ,ia, ji, ■ ■ ■ , jb are some 
non-random integers. Keeping for simplicity the implicit notation k^J^dZi we thus adopt hereafter 
the convention of accordingly decomposing such integral to a finite sum, taking for each of its terms 
the variable x^^} ■ ■ ■ x]^ outside the integral, resulting with the usual Ito adapted stochastic integrals. 
The latter are well defined, with [kt o dZ\^ being in L2({1, • • • A^} x [0, t]) (recall Proposition 12.11 that 
has uniformly bounded finite moments of all orders under the joint law Pj ® P^ j, hence so does 

the kernel A;|^(x)). 

Equipped with these definitions, we next claim that 



Lemma 3.3. Fixing t € M+, let ^/(x) = E[G*(x^)|jr^] and Z*(x) = E[Bi\Tr] for s E [0,t]. Then, 

dN 

■ XO,J 



under Pj (g) P^ j we can choose a version of these conditional expectations such that the stochastic 



processes 

(3.11) C/:(x) = 4-4+/ f'{KN{u))xidu 







(3.12) Zlix) = UHk)- / K(x)dn, 





are both continuous semi-martingales with respect to the filtration T^, composed of squared-integrable 
continuous martingales and finite variation parts. Moreover, such choice satisfies for any i and 
se[0,r], 

(3.13) V: + [krV]l = [krodU]i, 

and Vg = [kr o dZ]l for any i and all s < t. Further, for any u,v £ [0, r] and i,j < N, let 

(3.14) r^„(x) := e[(G*(x„) - K(x))(G^-(x,) - Vj {x))\J^r 



Then, we can choose a version o/r^\, such that for any s,v < t and all i,l < N, 

N 



il 

sv ■ 



(3.15) r ^M.du + Tl = h 

Proof: Since f/](x) = G'{xu)du + (see (EHJ), the relation Km between E[B*|:r^], [/](x) and 
E[G*(xu)|.7v] follows, as well as the continuity and integrability properties of the semi-martingales 
Us and Zs- Using hereafter to denote G*(xs), let 

(3.16) Lf = exp { / GidUiix) - - ^ / {Glfds} . 

^ i=i -^0 ^ i=i 

By Girsanov formula we have that the restriction to J-r satisfies, 

pAf I _ T NmN I ^ 
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Hence, with t > s, for any bounded ^^-measurable random variable 



(3.17) 



E[Gi$] = EjEp^ [Gi^] = Ep^ [EjfG^Lf ]$] = E 

XQ.J xo,0 



Ej[L;^ 



N] 



where the right-most identity is due to the change of measure formula Q^^ = Ej(Lf )P^g g for the 
annealed law = EjP^ j, restricted to !Fr- With ()3.17|) holding for all bounded .Tv-measurable 
it follows that, 



V:=E[Gl\^r] 



mow; 



N] 



Ej[Lf] ' 

and the identity (|3.13|) follows by the Gaussian change of measure identity ^CT^ of Proposition EH 
Exactly the same line of reasoning shows that, 



Ej[L; 



N-i 



and the identity (|3.15|) follows by the identity HC.3|) of Proposition ICll Noting that dZ = dU — V 
(see (|3.12j) l. we have by (|3.13|) that for all i and s G [0,r], 

[K O dZ]i = [kr O dU]i - [krV]i = 

as claimed. □ 
We now apply (|3.13|) to derive (|3.4j) . the easy part of Proposition 13.11 To this end, fixing s,t G 
[0,r]2 let 

N 



i=l 



for r = t V s, noting that since is measurable on J^^-, by (|1.15|1 . 



1 ^ 

i=l 



With t < T, combining ()3.13|) and ()3.11|) we get that 



N ^ N r ^ ^ r 

AN{t, ^) + ]^ E / ^^'tuVidu = ^ E / f'{K^{u))xikZxidu + ^ E / 

i,j=l ij=l ^ i,j=l ^ 



(suppressing the dependence of k\^^ and Vu on x, and following our convention regarding stochastic 
integrals such as x\k\l^dxu). Using the explicit expression of A;j^(x), and collecting terms while 
changing the order of summation and integration, we arrive at the identity, 

A]\!{t,s)+ / C]\!{s,u)v" {G]\i{t,u))AN{u,t)du + / u' {G]\i{t,u))AN{u, s)du 
Jo Jo 

f'{KN{u))CN{s, uy'{CN{t, u))Cn{u, t)du + r f{KN{u)y{CN{t, u))Cjv(n, s)du 

Jo 

(3.18)+ / CN{s,u)u"{CN{t,u))duCN{u,t)+ f u'{CN{t,u))duCN{u,s). 
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Applying Lemma (A. II for the semi-martingales x = y = z = w = x, and the polynomials Q{p) = v'{p) 
and P{p) = p evaluated aX a = t, 9 = s and v = t, we replace the stochastic integrals of 1)3. 18p by 

u'{CN{T,t))CN{r,s) - i.'(Cjv(0,t))C^(0,s) 



(3.19) - —CN{t,t) CN{u,sy'{CN{u,t))du--CN{s,t) u'{CN{u,t))du. 

Clearly, AN{t,s) = K[AN{t, s)\J-t] has the same uniform moment bounds of Proposition 12.31 as An 
and further inherits the self-averaging property (|2.20j) from Ajy. Hence, we may and shall apply 
Corollary 12.81 with possibly as one of the arguments of the locally Lipschitz function ^{z) of at 
most polynomial growth at infinity. Doing so for the functions ziZ2i^" (z^), and Ziv'{z2) and applying 
Corollary 12.81 also for f {zi)z2i'" {z^)z'i and f {zi)v' {z2)zz, upon utilizing the uniform convergence 
with respect to the points isj,tj) £ [0,T]^, we deduce from ()3.18|1 and 1)3. 19p that 



A%{t,s) + I CUs,uy'{C^{t,u))A%{u,t)du + u'{C^it,u))A%{u,s)du 

f{KUu))CUs,uy{C%{t,u))CUn,t)du 

+ / /'(i^^(n))i.'(C^(t,u))C7^K5)dn + z.'(C'^(r,t))C7^^(T,5)-z/'(C7^^(0,t))C7^^(0,5). 
Jo 

Finally, recall that 

(3.20) A%{t, s) = yl^(t, s) = D%{s, t) + /'(K^(t))C^(s, t) , 

with the corresponding replacement for A'^(u,t) and A'^{u,s). With r = t V s, we indeed arrive at 

We now turn to the more involved part of Proposition 13. 11 namely, the derivation of ()3.5() . To this 
end, as we have seen already, it suffices to consider s > t, as we do hereafter. To this end, taking 
T = s we use the notation Vu = E[Gu\J^s] of Lemma f3.3l while suppressing the dependence on x. 
Since = Ut — /g* G^dv with Ut being J^^-measurable, we deduce that 

E[GlBi]=E[GlUl]- f E[GlGl]dv = E\E[Gl\J^,m - f V^dv) - f Tfjv] , 
Jo L Jo Jo 

(recall that E{Gy - V^\J^s) = for all v < s and := E[{Gi - V^){Gi - V{l)\J^s] is per (Tmi) ). 
Further, by UTTIh and the identity jj^^] = [ks o dZ]i of Lemma ROl we get 

(3.21) E[GiBi] + E[ /* r%dv] = E{[ks o dZ]izi) . 

Jo 

Since = E[Bl\J^s] and [kg o dZ]l is .T-'^ -measurable, we have that 

E([A;, o dZiZl) = E{[ks o dZ]iBl) = E(E([A:, o dB]l\T,)Bl) , 

where the right-most identity holds since the kernel of the linear operator kg is .Fg-measurable and 
EpulJ'^j] = Zu for all u < s (recall that [kg o dZ]l is the L2-limit of discrete sums with mash size 
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going to zero). In view of and ()3.6() we have that 

[ksOdB]l = [ksOdxY, + [ksf'{KN)^]i-[ksG]i 

(3.22) = r v'{CN{s,u))dxl+ r u"{CN{s,u))xiduCN{s,u) 



+ / u'iCN{s,u))f\KN{u))xl,du + u"{CN{s,u))f\KN{u))CN{s,u)x\du 
v" {CN{s,u))x\^AM{u,s)du - / v'{CN{s,u))G\j^du 



Using Ito's formula for x\v' {Cn{s-,u)) we replace the two stochastic integrals in (j3.22|) by 
(3.23) 

/ 1 III ■ 1 

xIv'{Cn{s.,s)) - Xqv'{Cn{s.,u)) - —Cn{s,s) J v'" {CN{s,u))x\du - —x\ J u" {CN{s,u))du 

RecaU that by (tTT^ and (jlT^ 

FUs,t)+E[-Yl / Kldv]=E{-Y.^{[k,odB]l\Ts)Bl), 
i=i •'^ i=i 
which by the preceding is the expectation of 

Xn{s, ty{CN{s, s)) - X7v(0, ty{CN{s, 0)) 
- —Cn{s,s) i^"'{CNis,u))xN{u,t)du - — J iy"{CN{s,u))xN{s,t)du 

+ r f'{KN{u)yiCN{s, u))xn{u, t)du + r f'{KN{u)y{CN{s, u))Cn{s, u)xn{u, t)du 



(3.24)— j v" {CN{s,u))xNiu,t)Aj\f{u, s)du — j v' {C]\f{s,u))F]\f{u,t)du + KN{s,t) 
where in view of (11.151) 



i=i 



Recall (Hmi) that = Z\ - /^(G* - V'i,)dv, hence 

u'{Cn{s,u)) / {G\-V:){G\-Vi)dvdu 



^Nis,t) = ^Yl f ^'{CN{s,u)){Gl-V:,)Zldu-^Y. 

1 = 1 2 = 1 



JO 



As both v'{Cn{u, s)) and Zj are .Fg-measurable while E(Gm — 14|.Fs) = for all u < s, the expectation 
of the first term on the right-side vanishes. Further, conditioning on J^s, we have in view of 1)3. 14() 
that 

T ^ rs ft 
(3.25) E[KN{s,t)] = -E[-Y, i^'{Cn{s,u)) r^dvdu . 

JO JO 

All terms of 1)3. 24p apart from kjv are of the form covered by Corollarv 12 . 81 for functions ^'(2:) similar 
to those encountered in the derivation of (|3.4() . (namely, zih''{z2), ziu'" {z2)z^, zii'"{z2), f {zi)u' {z2)z^, 
f'{zi)z2v"{z'i)z2, and Z1Z2I'" {z^)) . Utilizing their uniform convergence and (|3.25|) . while recalling that 
X^(0,t) = 0, (|On)) and the analogous 

F^(n, t) = E%{u, t) + f'iK%iu))C-^is, u) , 
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is not hard to check that we get p.Sf) . once we prove the following lemma. 
Lemma 3.4. For v G [0, s], let 

i=l i=l 
(where T is defined with t = s). Then, for any t < s, 

t 

E[(j)N{s,v)]dv ~ 
Proof: Fixing v < s, recall that by (|3.6)) we have that 

(/)n{s,v)+—u"{Cn{s,v))Cn{s,v)-j^Y^ / u'\CN{s,u))xixlrildu = — "^^kll-Tll-^ kUTUdu 

Further, since we had t = s, the right-side is identically zero by (|3.15p . implying by the J-s- 
measurability of x^, x^ and some algebraic manipulations that 

N 

iu 

J fjj LV IX Uy/\ (J 17/1 "^J 

«J=1 



•^0 i,j=l 

/ iy"{CN{s,u))K\{AN{u,s) - An{u,s)){An{v,u) - ANiv,u))\: 
Jo L 



, - , , - , - 1-^ 

'0 

Consequently, with C]\fis,u) measurable on J^g we have that 

n(l)N{s,v)] = [\[u'\CN{s,u)){AN{u,s)-AN{u,s)){AN{v,u)-ANiv,u))]du-^E[u'\CNis,v))CNi^ . 
Jo 

In view of Proposition 12. 31 and (|2.20|) . the first term converges to zero uniformly in s, f by the uniform 
L2 convergence of An — A'^ (hence also of An — A^), and the uniform (in [0,T]^ and A^) bound on 
each moment of Cat and An (hence on those of An as well). By same reasoning, the second term 
converges to zero at rate uniformly in s,v. Utilizing the uniformity of the convergence, we see 
that Jq K[(l)N{s,v)]dv ~ as claimed. □ 

4. Differentiability and uniqueness for the limiting dynamics 

We start the proof of Theorem 11.21 bv the next lemma relating the solutions of (|1.17|) - (|1.20)) with 
those of Tm^ - THM . 

Lemma 4.1. Fixing T < 00, suppose {C,x, D, E) is a solution of the integral equations jl.lT}) - 
M.2i^) in the space of hounded continuous functions on [0, T]^ subject to the symmetry condition 
C{s,t) = C{t,s) and the boundary conditions E{s,0) = for all s, and E{s,t) = E{s,s) for all 
t > s. Then, x{s,t) = /q R{s,u)du where R{s,t) = for t > s, R{s,s) = 1 and for T > s > t, 
the bounded and absolutely continuous functions C, R and K{s) = C{s,s) necessarily satisfy the 
integro- differential equations Hl.l^ }- \1.14\ )- 

Proof: Consider the integral operator kc on C([0, T]) given by, 

[kch]{s) := — / u' {C{s,u))h{u)du , 
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and let 

f-s ptAs 

his, t) := -nCis, s))xis, t) - / xiu, ty'iCis, u))D{s, u)du+x{s, s)) - / u))du 

Jo Jo 

Then, per fixed t, the equation H1.20() states that E{s, t) = [kcE{-,ty\[s) + /i(s, t). Since the (continu- 
ous) kernel u'{C{s, u)) of kc is uniformly bounded on [0, T]^, it follows by Picard iterations (splitting 
[0,T] to sufficiently small time intervals to guarantee convergence of the series Y2n ^c)' ^^^^ 

(4.1) E{s,t) = y^[k2^h{.,t)]{s) = h{s,t) + r Kc{s,v)h{v,t)dv , 

n>0 -^0 

with a uniformly bounded kernel hq- Plugging l|4.1j) into (|1.18|) . we find by Fubini's theorem that 

rs i-tAv i-s 

x{s,t) = sf\t+ I [ i''{C{v,u))du]Ki{s,v)dv + / x{v,t)K2{s,v)dv , 
Jo Jo Jo 

for some uniformly bounded functions ki and H2 which depend only on C and D. Applying Picard's 

iterations once more, now with respect to the integral operator [k;25]('5) = Jq i^2{s,v)g{v)dv, we 

deduce that for some uniformly bounded K3 and K4, 



X{s,t) =sM + 







tAu 



{u At)K-i{s,u) + [ / i''{C{u,v))dv]K4{s,u) 







du . 



On s > t, the function s At = t is continuously differentiable, hence we easily conclude by Fubini's 
theorem that t — > x(s, t) is continuously differentiable on s > t, with x{s, t) = R{s, u)du for the 
bounded continuous function 

R{s,t) = 1 + [k3{s,u) + u' {C{u,t))Ki{s,u)]du . 

In particular, R{s,s) = 1 for all s. The condition E(s,t) = E(s,s) for s >t implies by H1.18() that 
xis, t) = x{s, s) for s >t. Similarly, with E{s, 0) = 0, it follows that x(s, 0) = for all s. From H1.17() 
we have that C{s, t) — xis, t) is differentiable with respect to its second argument t, with a bounded, 
continuous derivative D = 82(0 — x)- Consequently, 820 = D + R where R{s,t) = {82x)is,t) = 
for all t > s due to the boundary condition x{s, t) = xis, s). Further, C{s, t) = C{t, s) implying that 
diC{s, t) = 82C{t, s) = D{t, s) + R{t, s) on [0, T]"^. Thus, combining the identity 

/•t\/s 

C{s,tV sy{C{tV s,t))-C{s,oy{CiO,t)) = / u'{C{t,u))id2C)is,u)du 



t-tVs 

+ / C{s,uy{C{t,u)){d2C)it,u)du, 
Jo 

with (frT9|) we have that for ah t,s G [0, r]^, 

/•tVs ptVs 

(4.2) D{s,t) = -f'{K{t))C{t,s) + v'{C{t,u))R{s,u)du+ I C{s,uy {C{t,u))R{t,u)du . 

Jo Jo 

Interchanging t and s in 1)4.21) and adding R(t, s) = when s > t, results for s > t with 

{diC){s,t) = -f'{K{s))C{s,t) + [ u'{C{s,u))R{t,u)du+ [ C{t,uy {C{s,u))R{s,u)du , 



which is (rrT3|l for /3 = 1. 

Since K{s) = C{s, s), with C{s, t) = C{t, s) and 820 = D + R, it follows that for all h > 0, 



K{s)-K{s-h)= I {D{s,u) + R{s,u))du+ {D{s-h,u) + 

J s—h J s—h 



R{s — h, u))du . 
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Recall that R{s, u) = for u > s, hence, dividing by h and taking /i | 0, we thus get by the continuity 
of and that of for s > t that K{-) is differentiable, with dsK{s) = 2D{s, s)+R{s, s) = 2D{s, s)+l, 
resulting by ((121) with (fTTH) for /3 = 1. 

Further, it follows from (|1.18|) that {dix){u,t) = E{u,t) + lu<t- Hence, combining the identity 



x(s,ty{C{s,s))-x{0,ty{C{s,0))= u'{C{s,u)){dix)(.u,t)du+ I x{n,ty {C{s,u)){d2C){s,u)du , 
with (|1.2U|) we have that for all T > s > t, 

(4.3) E{s, t) = -f\K{s))x{s, t) + / x(n, ty{C{s, u))R{s, u)du 



(recall that x(0,t) = x(0,0) = 0). Let 
(4.4) g{s,t) := -f'{K{s))R{s,t) + I R{u,ty {C{s,u))R{s,u)du , 



for s,t G [0,T]^. Recall that x{s,t) = R{s,v)dv, so by Fubini's theorem, (|4.3|1 amounts to 
E{s,t) = g{s,v)dv for all s>t. Further, with E{s,t) = E{s,s) when t > s, it follows that 



ptAs 

E{s, t) = g{s, v)dv 
Jo 

for all s, t < T. Putting this into H1.18() we have by yet another application of Fubini's theorem that 

ps ptAu pt ps 

R{s,u)du = x{s,t) = t + / / g{u,v)dvdu = t + / / g{u,v)dudv , 

Jo Jo Jo Jv 

for any s >t. Consequently, for every t < s, 

R{s,t) = l + J g{u,t)du, 

implying that diR = g for a.e. s > t, which in view of ()4.4() gives H1.12() for /? = 1, thus completing 
the proof of the lemma. □ 
We proceed by showing that the system of equations of interest to us admits at most one solution. 

Proposition 4.2. Let T > and At = {s,t e (M+)^ : < t < s < T}. There exists at most one 
solution {R,C,K) E CI{At) x CI{At) x Cl{[0,T]) to fS}:= il.liil.l,'il.U\ ) with C{s,t) = C{t,s) 
and boundary conditions 

(4.5) R{s,s) = 1 Vs>0 

(4.6) C{s,s) = K{s) Vs>0 

C(0,0) = K{0) known. 

Proof: As mentioned already, we may and shall take (3 = 1 (by scaling P'^u i— > i/, with i— > ip 
accordingly), just as we have done throughout this paper. 

Assume that there are two solutions {R, C, K) and {R, C, K) of (S) with boundary condition 
fBCl:= H4.5l4.6|) . We shall prove by Gronwall's type argument that these two solutions have to 
coincide. To do so we first show that the response function 72 is a Lipschitz function of the covariance 
functions (C, K) and then that the covariances obey integro-differential Gronwall type inequalities. 
We then use Gronwall arguments repeatedly to conclude. In what follows, T is fixed and all the 
constants (which eventually depend on T) will be denoted by M, even though they may change from 
line to line. 
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• R is a Lipschitz function of the covariance 

Let {R, C, K) be a solution to (S) and denote 

Hc{s,t) :=e/t'-^'(^("))'^"i?(s,t). 
Then, from (|1.12|) and (|4.5j) . we deduce that H satisfies 

dsHc{s,t) = Hc{u,t)Hc{s,u)u"{C{s,u))du, for s>t, H{t,t) = l. 

Note that H only depends on C. This equation was studied in |16. where it was shown that if 
'NCn denotes the set of involutions of {1, • • • , 2n} without fixed points and without crossings 
and if cr(cj) is defined to be the set of indices 1 < i < 2n such that i < cr{i), H is given by 

(4.7) Hc{s,t) = l + Y, [ E U ^"iC{t„(^i),ti))dti---dt2n 



The number of non-crossing partitions |NC„| of 2n elements is given by the Catalan number 
Cn which is at most 2". As /j<j^...<j2 <s '^^i " " ' '^*2n < M/ (2n)! and sup(i .,)g^^ h'"{C{s, t)) is 
uniformly bounded by hypothesis, the above sum converges absolutely. Further, telescoping 
each HiecrM ^"(C(*<7(i), - DiecrM ^"iC{t^{i),ti)), by the uniform Lipschitz continuity 
of on compacts, we thus find a finite constant M such that for any pair C,C £ CbiAx) 
and any t,s £ At, 

(4.8) \Hc{s,t)-H^{s,t)\<M [ \C{ti,t2)-C{ti,t2)\dtidt2. 

Jt<t2<ti<S 

Thus, if {R,C,K) and {R,C,K) are two solutions of (S) in CI{At) x CI{At) x Cl{[0,T]), 
since K is uniformly bounded and /'(•) is locally Lipschitz, we obtain 

(4.9) \R{s,t)-R{s,t)\<M [ \C{ti,t2)-C{ti,t2)\dtidt2 + M f \K{u) - K{u)\du. 

Jt<t2<ti<S Jt 

• Bounds on the difference of the covariances on s > t 
Integrating (|1.13j) yields for s > t 

C{s,t) = K{t)- f'{K{u))C{u,t)du+ du dvv'{C{u,v))R{t,v) 



Jt Jt Jo 

ps rt ps ru 

+ du dvv"{C{u,v))C{t,v)R{u,v) + I du i dvu" {C{u,v))C{v,t)R{u,v). 
Jt Jo Jt Jt 

Hence, if {R,C,K) and {R,C,K) are two solutions of (S), 

S /"S S /'t 

\C-C\{s,t) < M\\K-K\{t)+ \K-K\{u)du+ \C - C\{u,t)du + du dv\C-C\{u,v) 
L Jt Jt Jt Jo 

+ du dv\C - C\{t,v) + du dv\R- R\{t,v) + du dv\R-R\{u,v) 



ps pu ps pu ^ ps pu ^ 

+ I du I dv\C - C\{u,v) + I du I dv\C -C\{v,t)+ i du i dv\R-R\{u,v) 
Jt Jt Jt Jt Jt Jt 

(4.10) := his,t)+l2{s,t) + ---+Iiois,t) 
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• Bounds on the differences of the covariances on the diagonal 
Similarly, integrating ()1.14() gives 



K{t) = K{0)-2 f'{K{u))K{u)du + t + 2 du dv7p{C{u,v))R{u,v) , 
Jo Jq Jo 

yielding in case K{0) = K{0) that 

(4jH^K|(t) < M I \K-K\{u)du+I du l \C - C\{u,v)dv + i du l \R-R\{u,v)dv 
LJo Jo Jo Jo Jo 

Plugging ()4.9|) into H4.11() yields 

(4.12) \K-K\{t)<M[[ \C - C\{t2,ti)dtidt2+ [ \K - K\{u)du] 

Jo<ti<t2<t Jo 

Recall that by Gronwall's lemma, if h, g are two non-negative functions such that 

h{t) < g{t) +A I h{s)ds 
Jo 

for some j4 > 0, then 

h{t) < g{t) + A [' g{v)e^^'~''Uv < e^'g{t) 
Jo 

where the last inequality holds when g is non-decreasing. Applying this inequality with 

g{t) = I \C - C\it2,ti)dtidt2 

which is non-negative and non-decreasing yields 

(4.13) \K-k\{t)<M[[ \C - C\{t2,ti)dtidt2] 

Jo<u <to<t 



The final fixed point argument 
We now consider 



D{s) := / \C - C\{s,t)dt, 

Jo 

noting that and imply that 

(4.14) \R{s,t)-R{s,t)\<M [ \C{ti,t2)-C{ti,t2)\dtidt2 = M [ D{ti)dt 

Jo<t2<ti<s Jo<ti<s 



and 



(4.15) \K-K\{t)<M[[ D{t2)dt2]. 

Thus, integrating (|4.1U|) with respect to t and observing that 

/ {Ii{s,t) + l2{s,t))dt < M D(u)du bv Km . 
Jo Jo 

/ {h{s,t) + l8{s,t))dt < M dt du dv\C - C\{u,v) < M D{u)du and 
Jo Jo Jt Jo Jo 

/ {l9{s,t) + l5{s,t) + l3{s,t))dt < M D{u)du by definition of D and Fubini, 
Jo Jo 

/ {I(i{s,t) + Iris, t) + hois, t))dt < Ml dt I du dv\R - R\{u,v) < M D(u)du bv KWi . 
Jo Jo Jt Jo Jo 
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we obtain from H4.10() that 

D{s) <m[ D{u)du . 
Jo 

Recall that D is non- negative and non-decreasing, so by the preceding Gronwall argument, 
now with g = we conclude that D(s) = for all s G [0, T]. This in turn implies by H4.14() 
and that 

K(t) = K(t), R{s, t) = R{s, t) for all {t, s) G At 

and C{s,t) = C{s,t) for almost all t < s and all s <T. Either by H4.1U() or directly by the 
continuity of the covariances we conclude that 

C(s, t) = C{s, t) for all (t, s) G At 

which finishes the proof. □ 
We conclude this section with the. 

Proof of Theorem ll.2t Recall ProDosition l2.3l that we have pre-compactness of (^^, F'^, Xn^ ^n) ' 
[0,T]^ — > M^, in the topology of uniform convergence on [0,T]^. This implies the existence of limit 
points for this sequence. By Proposition 11.31 every such limit point is a solution of the integral 
equations (|1.17|) - (|1.2n|) with the stated symmetry and boundary conditions. By Lemma 14.11 each 
such solution results with C and x R) that satisfy the integro-differential equations (|1.12|) - 

(|1.14|) . In view of Proposition 14.21 the latter system admits at most one solution per given boundary 
conditions. Hence, we conclude that the sequence {xliiCfj) converges uniformly in [0,T]^ to the 
unique solution of (|1.12I) ~ H1.14() subject to the appropriate boundary conditions. Further, by 1)2. 19(1 
of Proposition 12.41 both Cn — Cff and xn — Xn converge uniformly to zero, almost surely. Thus, the 
solution of H1.12() - ()1.14() is also the unique almost sure uniform (in s,t) limit of {xN,C]y), as stated 
in Theorem ll.21 The Lp convergence then follows by the uniform bounds on moments of Cn and xa^ 
(see Proposition 12 . 3|) . thus completing the proof of the theorem. □ 



Appendix A. Ito's calculus 
Let {{xl,yl, zl,wl}t>o,i G N} be semi-martingales such that, 

d{r\p')t = 6i=jdt 

for any p, r G {x, y, z, w}. Denoting, for p,r £ {x, y, z,w}, s,t > 0, N £ N, 

N 

N 



1 ^ 



i=l 

we already made use of the following simple stochastic calculus lemma. 
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Lemma A.l. For any polynomials P, Q, and any a,9,v > 0, 

P'iK^Ju, e))Q{K^^Ju, v))duK^^y{u, 9) 







+ / P{Ki]yiu,9))Q'{K':^Uu,v))duK':^^iu,v) 
Jo 

0) r P"{K^,y{u, 9))Q{Kf^Ju, v))du 

J 



+ 2^<«,(^,«) /„ P{Kly{u,9))C^'{Kl^{u,v))du 



+^K^^J9,v) l\\K^Ju,9))Q'{K^^Jn,v))dn 



where 

N 



N 

i=l 



and all the stochastic integrals are defined via our convention (of putting terms such as y^Q ■ ■ ■ Uq^wI^ ■ ■ ■ wi'' 
outside the integral). 

Proof: By the bi-linearity of the formula given, it is enough to prove the lemma for P{x) = x°' and 
Q{x) = . In this case, writing 



■wi^{x'^---xl^zl^---zl^) , 



h,--ia ji,-jb 

and using Ito's formula for xj/ • • • x^^zi^ ■ ■ ■ zi'' gives the stated result. □ 

Appendix B. Supremum of Gaussian processes indexed on large dimensional spheres. 

In this section we prove the bound (|2.12p which is a direct consequence of the following general 
lemma about supremum of Gaussian processes indexed on large dimensional balls. The outline for a 
direct proof of such a result by a chaining argument was kindly communicated to us by A. Bovier, 
whom we thank gratefully. This chaining argument can be adapted rather straightforwardly from 
[S]. Anton Bovier also mentioned that this result should be the consequence of a more general one. 
We have indeed found the proper way to see it as a consequence of classical and well known facts on 
Gaussian processes, and to give simple references. 

Let (AAr(x)) be a sequence of real valued, centered Gaussian processes indexed by x G M^. 
Consider, for every p > 0, the closed Euclidean ball B]\f{0,p) in M^, and define 

^* , , l^^(x)| 
Xj^{p) = sup 



x6Bjv(0,p) VN 

We will also introduce the usual metric on associated to the process X^, 

dx(x,y)=E[|A^(x)-A^(y)|2]V2 

We denote by || • || the Euclidean norm and by (x, y)/vr the corresponding inner product on M^. 
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Lemma B.l. Suppose that 

(B.l) supE[XAr(0)2] < oo 

N 

and that 

(B.2) sup sup -r TT < oo . 



N x,yeBiv(0,p) 



Then, for every A; G N 



(B.3) supE[X!V(/?)1 < oo. 

N 

Moreover, there exists a constant k < oo such that for all N and every t > 0, 
(B.4) P[^iv(/o) >ti + t]< exp{-Nt^/K) . 

Proof: This result is a direct consequence of Dudley's theorem (^Sl)- Indeed, the assumption (|B.2() 
implies that for any and e > one can cover Bj\[{0,p) by the union of certain C{p)e~^ balls of 
radius e, in the metric dx, where the constant C{p) depends on p but not on the dimension N . Thus, 
Dudley's theorem (see also jl8l Theorem 11.17]) shows that 



E[ sup X^(x)] < C'(p)ViV, 

xeBjv(0,p) 

where the constant C'{p) again depends only on p and not on A^. Using the obvious fact that 
E[ sup |X,v(x)|]-E[|X^(0)|] < E[ sup |Xjv(x) - X,v(y)|] 

xeBjv(0,p) x,ye-Bjv{0,p) 

= E[ sup {X^(x)-Xjv(y)}] =2E[ sup X^(x)] , 

x,y6Biv(0,p) xGBiv(0,p) 



and the assumption ()B.lj) . we see that the conclusion HB.3|) holds for k = 1. Thus, X^r admits a 
version with almost all sample paths bounded and uniformly continuous on Bn{0,p). One can then 
consider Xj^ as an (infinite dimensional) Gaussian vector in the space of continuous functions on 
the ball Bj\f{0,p), equipped with the supremum norm. It is also a well known fact that, for such a 
Gaussian vector, all moments of the norm are controlled by the first (e.g. see the last statement of 
jl8l Corollary 3.2]). This is thus enough to ensure that HB.3|) holds for every k G N. 

The tail estimate ()B.4|) is also classical in the Gaussian context. For instance, the assumptions 
(|B.1|) and ()B.2|) immediately imply that the weak variance 

a{XN) = sup |e[X^(x)2]V2| 

xeBjv(0,p) J 



of ^1 page 56] is bounded in N. Hence, by |I3 estimate (3.2), page 57] it is easy to see that there 
exists a finite constant k > sup^y E[Xi!^(/5)] for which (|B.4|) applies. □ 
We proceed to apply Lemma IB. II to the situation of interest here. To this end, fixing p G N 
consider the Gaussian process defined on {R^)p by 



^Ar,p(x) = ^ ^i^yxt, x7„x7., ■■■x: 



^^2 3 ___^p 

l<ij<N,l<j<p 



with independent, centered Gaussian variables Gjj^ ... of variances c({ii, . . . ,ip}) of (|1.3|) . Con- 
sidering in (M^)P the Cartesian product 

B{p) = f[{^'eR^,\WW<p} 
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of p Euclidean balls, we wish to estimate the moments and tail of sup^g^^p) |XAr^p(x)|. To this end, 
note that since X^v.p is a symmetric p- linear form on (i-e., XAr^p(x) is invariant to permutations 
of the vectors x-*^, . . . ,xP), we have by polarization that 

(B.5) sup \XN,pi^)\<Cip) sup |Xjv(u)|, 

xeB(p) l|u||<pp 

where one defines Xn{u) for u G by 

XAr(u) =XAr,p(u, ...,u) = ^ G{i^^... ^i^yUi^Ui^Ui^ ■ ■ ■ Ui^ . 

l<ij<N 

The Gaussian process Xj\f{u) obviously satisfies ()B.1|) since Xjv(O) = for all A^. Turning to check 
that ()B.2|) is satisfied as well, note that 

N 

X^(u) =iV(P-i)/2 J^G^(U)7X,, 

1=1 

for the case where i/'(r) = (p- l)!rP"^ Thus, by (jSH) and (ESJ, the covariance of the process X]\[ is 

E[X^(u)Xjv(v)] =p!(u,v)^, 

so that 

dx{u,vf=pl (u,u)^ + (v,v)^ - 2(u,v)^ . 
It is then easy to check that for all u and v, 

dx(.u,v) < C(p)||u-v||, 
yielding that HB.2|) holds. Hence, by Lemma IB. 11 for every positive integers p and k, 

(B.6) supE[ sup < supE[XiV(p)^l < oo . 

xeB{p) vN N 

In view of (|2.1() . combining (|B.6|) for p = 1, . . . ,m then proves the bound (|2.12|) . We further have by 
HB.4|) and ()B.5|) that for some k < oo, any p < m, all and every i > 0, 

r[ sup (^^X^) > K + t] < exp(-iVtV^) , 

from which it follows that, 

(B.7) P[||J||^ >K + t] <me^p{-Nt'^/K) . 

Appendix C. Gaussian change of measure identities 

The change of measure that is key to the proof of Lemma 1,3.31 is a special case of the following 
"standard" Gaussian computation (compare (|3.16|) and ()(y.H) ). 

Proposition C.l. Suppose under the law¥ we have a finite collection J = {Ja}a of nan- degenerate, 
independent, centered Gaussian random variables, and G\ = JaL\{a) for all s G [0, r] and i < N , 
where for each a the coefficients L\ which are independent of J are in L2{{i, ■ ■ ■ ■, A^} x [0, r]). Suppose 
further that UI is a continuous semi-martingale, independent of J and such that for each a the 
stochastic integral 

N 

:= V / Li{a)dUi , 
i=i 
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is well defined and almost surely finite. Let F* denote the law of J such that P* = Lr/^{LT-)f, where 



(C.l) = exp { 5^ / G\dUl - 2 E / • 

Let k\{ = F.{G\Gi), = W{G\) and T\{ = E*[(Gj - Vi){Gi - Vi)]. Then, for any s < t and i < N, 

(C.2) V: + [krV]i = [krOdUi, 

and for any s,t < t and i,l < N , 

(C.3) 2. / Ku^utdu + ^It = Kt ■ 

j=i ^° 

Proof: Let Vq, = E(J^) > denote the variance of Ja and 

N 

(C.4) Ra^:=Y. / LUa)Lii^)du, 

i=i -^0 

observing that 

L/t — exp ^ ^ ^ JaP'OL 2 ^ ^ JaJ'yLla^^ ■ 

With D = diag(uQ) a positive definite matrix and R = {Ra'y} positive semi-definite, it follows from 
this representation of L,- that under P* the random vector J has a Gaussian law with covariance 
matrix (D~^ + R)^^ and mean vector q = {qa} = (D~^ + R)~^/x. Hence, for any a, 

(C.5) Qa+Va'^ Ra-yQ-f 



7 



As klu = J2a Ll{a)vaLu{a), it is not hard to check that 



N 

[kr o dU]l := / f^dUi = ^ L;(a)t;„M« • 



Obviously, = X^a-^U'^)^^ ^o we get (|C.2() out of HC.5() upon verifying that 

N ^ N r 

l''rV]i := E / = E ^:(«)^"^7 E / Li{a)Li{j)du = ^ L:(a)^;„i?. 



with the last identity due to ()C.4|) . 

Turning to prove (|C.3() . since r:^^ is the covariance of Gd and G[ under the tilted law P*, we have 
that 

r^', = ^Li(a)[(D-i +Rr%Lj(7) , 
and hence by HC.4|) we see that 

N 

/ kt^^ri!,du = YLi{awmj^-' + . 

j=l "'O a,'r 

With D = diag(vo) we easily get ()C.3|) out of the matrix identity (I + DR)(D"^ + R)"^ = D. □ 
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